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ABSTRACT 

The introduction of digital datalink communications into the ATC may cause a iw^tion of the 
1 .4., ^ ^ mlucacoriwy U«- WonMIkx. (HJ) am can be 

ovataari on me shared voice ertqoMicies. AsoiveywasdiaiibolcdlodeioiiliimaiiitMPUi^^ pdMs 

from diffaent geographic regions, operational groups, experience levels and anciaft 
ineii/Hitihri high^^^ved importance for H-I during the phases of flight nearest the anpo^d lowest 
imoortanceSiringOntise. Several specific traffic and weather infonnation elements were identifi^ 
nartkularly imptmtant; traffic and weather infonnation was also died by pflots as infl^at^reqiured for 
sitiioii^reness. Some variations in responses were found between pilots from different 

q)etati(Mial types. 

INTRODUCTION 

As Dart of the Federal Aviation Administration’s (FAA) Nationid Airsp^ Systeni moda^tion 
plan, digital datalink communications will be introduced as a means rf ag/groimd ^or^o n ex^ 
between aircraft and ATC facilities. Communications via datalink offer potcndalbraefite m 
system safety and efficiency by reducing transmission and interpretation enore arrf by 
information to be exchanged between aircraft and ground facilities. On the otto hai^ tte transfer of ATC 
fifom voice to datalink gives rise to numerous human Cactors issues mduding a possible 

SrSSSw^uS^awareness. SpecificaUy. the discrete rutturerf datali^^ 

ATC meJage is directed exclusively to a specific aircraft) may result ^ 

Infonnation (PU) obtained by overhearing communications betwe« ATC ^ otto ant^t 

rf important PLI elements is necessary to fram a basis by vduch compensatory datalink 

protocols or strategics C3n be developed. 


tj Kmrnx>r\i tmti 


Previous Woric 

With the current system rf voice ATC communications <m shared Vlff ^uenc^, aircrrft 
overhear all conversation on their frequency, thereby having access to a great 

infonnation. This PU is used by pilots to increase their situation awareness with re^t to other aircraft, 
environmental conditions, sector congestion and controller workload. 

To detennine the significance of PLI, an initial survey was distributed to 1^ America Airline 

Dilots based at Chicago O’Hare. This survey identified the PU elements judg^ to bempratant by ^ 

carrier crews with the most important being Windshear. Aircraft on LandtngfTake-QffRunwt^, Braking 
Approach lotion. In nddifa.. PU was indkaKd as men nnponant dunng 

terminal operations and on final approach (Midlriff, 1993). 

Research Focus 

This research expanded upon the previous survey to determine PLI u» by pilto of different 
nnpnitinn tvDes flinht experience, aircraft equipage and geographic regions. The number of eleinents 
sS^yed ^^eipanded traccount for the different flight operations and to better dctOTiune the tmport^e 
of specific weather information elements. In addition, free response questions were asked to determine the 
information required for global situation awareness. 
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METHOD 


Survey Design 


The survey was organized into three sections. The first section gathered information about the 
respondents’ characteristics and flight experience. The second section investigated issues relating to 
datalink implementation and also to the information requirements for global situation awareness by asking 
“What does the ‘Big Picture’ mean to you?”. 


The fi na l and largest section of the survey soUcited pilot input on the importance, availability 
accuracy of ‘Party Line’ Information for specific information elements. The elements w^Mtegt^d 
into the six phases of flight listed in Table 1; most elements were listed in aU Phases o^ght, while others 
were listed only the Phases of FUght in which they would be applicable. As shown m die ^ple section in 
Figure 1, the subjects were asked to rank the importance, availability and accuracy on 5 poim scdes, where 
the numbers 1 and 5 represented the extremes Trivial vs. Critical for the unportance raring, Non-Existent 
vs. Common-Place for the availability rating, and Uiueliable Vs Reliable for the accuracy raring. 


Ground Operatimis 
Departure 
Cruise 
Descent 
Terminal Area 
Hnal Approach 


Pre-Start, Taxi 

Takeoff to Top of Climb 

Top of Climb to Top of Descent 

Top of Descent to Approach Control Contact 

Approach Control Contact to Final Approach Fix 

Final Approach Fix to Runway Threshold 

Table 1 . Phases of Flight Surveyed 


Importance 


Trivial 

Cniise : Top Of Climb To Top Of Descent 


Next Communications Frequency 1 2 

Weather Situation 

- Over- All i 2 

- IRW Bufidiqis & Deviations 1 2 

- Visibility & Ceiling 1 2 

- Icing CtMiditions 1 2 

- Ride RepcHts/Turbulence 1 2 

- Winds Aloft 1 2 

- Surface Winds 1 2 

Traffic Avoidance 1 2 

Relative Sequencing Of Other AJC 1 2 

Error OT Mistake of the Controller 1 2 

Other 1 2 


Critical 

3 4 5 

3 4 5 
3 4 5 
3 4 5 
3 4 5 
3 4 5 
3 4 5 
3 4 5 
3 4 5 
3 4 5 
3 4 5 
3 4 5 


AvailabUitv ACCUtaCY 

Common- 

Place Unreliable Reliable 


Non- 
Existoit 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 


1 2 3 4 5 

1 2 3 4 5 
1 2 3 4 5 
1 2 3 4 5 
1 2 3 4 5 
1 2 3 4 5 
1 2 3 4 5 
1 2 3 4 5 
1 2 3 4 5 
1 2 3 4 5 
1 2 3 4 5 
1 2 3 4 5 


Figure 1. Sample of Importance, Availability & Accuracy Ratings Section (Cruise Phase of Flight) 


Subjects 

4375 surveys were distributed, targeting five different operational groups: General Aviation pilots. 
Commuter Airline Flight Crew, Major Airline Flight Crew, and Military pilots. 710 complete le^nses 
were received. The response rate of 16.2% was considered reasonaUe for a vduntary survey of this type, 
particularly due to its extensive nature. However, some response bias may be present. 

Data Analysis 

The i^ciple data consisted of importance, availability or accuracy ratings on a five point Kale. 
The importance of a specific element within each phase of flight was calculated from the in^ of ^ 
responses for that element The mean of all elements within the survey sections corresponding to ^erent 
phases of flight were calculated from all elements within that section. The responses were ^ subdivided 
lyicpH on respondent characteristics, such as total flight hours or type of flight operations with similar 


mfa ns for these subdivisions. Standard t-tests were conducted to analyze the differences in the 

numerical importance data. (Hogg & Ledolter. 1992) Given the discrete number of ratmgs a pilot codd 
choose, a high importance rating for an element indicates a strong consensus between pilots on its high 
import^e. Therefore, a metric to display and illustrate the relative importance of PLl elements is the 
percentage of pilots giving a Critical (5) rating, or the next highest rating (4), which is assumed to represent 
an Important rating. 


The questions “What does the ‘Big Picture’ mean to you?” solicited free responses from pilots. 
For data analysis, common responses were identified and categorized. These responses were talbed m 
common categcmes. Because the pilots were free to mention several answers, the occunaires of all 
responses sum to a value greater than 100%. Hypothesis tests compared the percentage of frw response 
cat^ories given by different groups of pUots, assuming that the percentage trf reqxmscs withm each 
category could be given a Bernoulli probability. (Drake. 1967) 


RESULTS 


Overall Importance Ratings 

The pilots overaU rate very highly. Across aU the information elements, the ^g 

was aiven 42% of the time and the next highest Important rating was given in an additional 28% of tlK 
responses. The individual elanents were also rated highly. While the ratings for the elemrats i^ge from 
2.40 to 4.83 (Ml the (1) Trivial to (5) Critical scale, most ot the mean ratings were above 4.00 and many ot 
die elements were ju(^ged to be Critical by a majority of the pilots. 


lmp(Miance Ratings by Phase of Flight 

An overall comparison of the perceived variations of PU importmee b^cen ^errat Ph^es of 
Flight was made by comparing the combined ratings of all PLI elements list^ with each, as shown in 
Figure 2. The highest ratings were give to the Phases of Flight nearest the aiiports. eqictaally Terminal 
Area and Rnal Approach, where over 40% of the combined ratings were Critical. The lowst unportance 

ratings are given in Cruise, where less than 30% of the ratings were Critw^ The ratings for each 

successive Phase of Flight are significantly different from the one preceding (p < 0.01), except between the 
ratings for Rnal ^JjMoach and Terminal Area. 
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ngure 2. Combined Importance Ratings of AU PU Ekmcntt for Each Phase of Flight 

In general, the individual weather and traffic PU elemenis received importance ratings foUowing 
the same pattern of highCT imptMlance ratings in the Terminal Area and Final Approach, airf lower 
importance ratings in Cruise. However, some weather elements, such as T^^torm Buildups and 
Deviations and Icing Conditions were consistently paccived as important m all Phases of FhghL utner 
weather elemenis, such as Ride Reports & Turbulence and Winds Aloft reived higher ratmgs m Cruise. 
This identifies very specific patterns of PLI use by pilots throughout a flight 



Identification of the Most Critical Elements 

Many PLI elements were rated as Critical by a majority of the pilt^ for at least one phase of 
nisht, indicating a strong consensus among pilots that these elements are vital for flight (^)er^ons dunng 
some or all phases of flight These elements tend to api^y to traffic and weather situations which d^tly 
affect flittht safety. Other PLI elements received ratings of Critical or Important firom a majonty of the 
pilots. Bements considered Important by a majcKity of the pUots include ^ Traffic and Weather element 
useful for flight planning. Some elements are considered Critical by a majonty of pilots m some Phases of 
Flight and Ii^XHtant in other Phases of Hight. These elements and the Phases of FUght m which they 
received these high ratings are shown in Table 2. 


Informati on Elements Rated Critical 

• Aircraft on Landing Runway 
(Final Approach) 

• Traffic - Uncontrolled Airports 

(Departure. Descent, Terminal Area i. Approach) 

• Traffic - Controlled Airports 

(Departure, Descent, Terminal Area & Approach) 

• Traffic Avoidance 
(Cruise) 

• Windshear 
(Final Approach) 

• Missed ^)|Hoach - Weather 
(Final Approach) 

• Visibility & Ceiling 

(Terminal Area Final Approach) 

• Thunderstorms 

(All Phases of Flight) 

• Surface Winds 
(F inal Approach) 

• Braking Action 
(Final Approach) 

• Icing Conditions 

(Departure, Descent & Terminal Area) 

• Aircraft Crossing Active Runway 
(Ground Operations) 

• Approach Clearance 
(Terminal Area) 

• Terminal Routing 
(Terminal Area) 

• Missed A^iroach - Other 
(Final Approach) 

• Error of Controller 

(Ground Ops, Terminal Area A. Final Approach) 


Informat ion Elemerits Ra*ed Important 

• {folding Situadon/EFC Validity 
(Descent A Terminal Area) 

• Relative Sequencing of Other Aircraft 
(All Phases of Fttght) 

• “Hold Short” of Runway 
(Ground Operations) 

• Taxiway Turnoff 
(Final Approach) 

• Routing to (Take-Off) Runway 
(Ground Operations) 

• Weather Otverall 
(All Phases of Flight) 

• Visibility & Ceiling 

(Ground Operations. Departure A Descent) 

• Ride Reports & Turbulence 

(All Phases of Flight but Ground Operations) 

• Surface Winds 

(Ground Operations. Descent A Terminal Area) 

• Icing Conditions 

(Ground Operations. Cruise A Final Approach) 

• Error of Controller 
(Departure. Cruise A Descent) 

• Next CtHnmunications Frequency 
(Descent. Terminal Area A Final Approach) 


Table 2. PLI ElemenU Rated Crilfcal or Important by a Majority of Pilots 
Variance in Importance Ratings Between Pilots of Different Charactcnstics 

To study possible variations between importance ratings given by pilots from different (^rational 
types, the responses of General Aviation, Commuter Airline, Major Airline and Military pilots were 
compared. Several significant differences in perceived PLI importance were found. 

First, General Aviation pilots rated PLI as consistently important in all Phases of Flight, without a 
signific ant drop in PLI importance during Cruise. This differs fiotn the other pilots who perceive PLI to be 
more important in the busy Phases of Flight nearest the airport. This effect can be seen in Figure 3. 
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Broken Down by Pilot Type 


Cruise 


Descent 


Terminal 

Area 


Hnal 

Approach 


Second, certain PU elements were rated significantly higher by specific groups of pilots. These 
; are summarized in Table 3. 






O^AwaliMi Icing Conditions, Visibilily 4 Ceiling. Winds AWl. Reblive s«iuenciiig. 

Next Communication Frequency 

Commuter Airline Traffic Avoidance - Uncontrolled Airports 

Major Airline Ride Repwts & Turbulence, Routing to Runway, Hold Short , 

Braking Action — — : — n 

Traffic Avoidance -- Controlled Airports & (Cruise) Traffic Avtxdance 

Table 3. Elements Perceived More Important by Pllott of Different Operathmal Types 

Attempts were made to isolate differences between pitots based on flight e^i^nce, as estim^ 
by total flight hLs. However, different experience levels corresponded cl^ly wth 
oDoations “ fw example, the General Aviation pilots, on average, had significMdy few ffight hours ^ 
aS oSier group of pUots and the Major Airline pilots had significandy more fii^t j 

group. Therefore, the variations in importance between pilots of (Merent ^ 

wifli the variations found between the different user groups. Withm each the respon^ from 
operational group, no differences could be found between pitots wito t^crentexpc^ suggestmg that 
opeiationa] type is the strongest determinant in pilots perception of PLI importance. 

Few significant diffoences could be found between pitots from diff^t geographic regions, or 
between pilots flying aircraft equipped or not equipped with weather radar or TCAS. 

Availability and Accuracy Ratings of PLI 

Unlike the Importance ratings where the extreme rating of ‘5’ was comnion. pUots generally did 
not give the maximum ^ue for the Availability and Accuracy rating. In^, ^ 

indicted that pUots consider PU generaUy reliable and accurate without givmg any significanUy higher 

ratin gs to any PLI elements. 

The Availability and Accuracy ratings for most PU elements were strongly corte^ 

Importance ratings. However, some PLI elements. Next Communicanons Frequency. ConiroUed 
A^^h^arance. Terminal Routing and Surface Winds, were found to tave high Availability ^d 
Acc^y r^s compared to their importance ratings, possibly indicating their continues pr^ritation by 
Party Line communications. Conversely, the PLI elements Error of the Controller and Uncontrolled 


Trc^c were found to have dispropoitional low Availability and Accuracy ratings, possibly indicating that 
Party Line Communications is not an adequate information source for these elements. 

Information Requirements for Global Situation Awareness 

To ascertain the information required for Global Situation Awareness, pilots were asked for free 
responses to the question “What does the ‘Big Picture’ mean to you?". Hicir responses were categorized 
and the percentage of responses in each tally was recorded. These results are shown in Figure 4. Traffic is 
named significantly more often than any other information (p<0.01); the next item. Weather, is also cited 
significantly more often than any of the less mentioned items. 



Traffic Weather Predict and Safety Communica Alternate Competence 
Situation Situation Plan Ahead tkm Courses of Others 


Figure 4. Percentage of Responses to “What does the ‘Big Picture’ mean to you?” 

CONCLUSIONS 

PLI currently provides pilots with information considered to be vay important. However, given 
the ambivalent accuracy and availability ratings given to PLI, better transmission and display modalities 
may be found. The p-esentation of information currently available from PLI must be a consideration dunng 
implementation of datalink communications. The importance of PLI was found to be significantly higher 
in the busier and higher density Phases of Flight near the airpwt, suggesting any initial implementation of 
datalink communications in Terminal Area control sectors will need to be well compensated for PLI loss. 

Specific Traffic and Weather PLI elements were identified as Critical. These results, combined 
with the common citing of these two types of information as necessary for ‘The Big Picture , suggest 
Traffic and Weather information is required for pilot Global Situation Awareness. 

The implementation of TCAS and the availability of better, less expensive weather displays may 
enhance PLI use and help compensate for its loss in the datalink environment However, little is known 
about these effects, suggesting further studies in these areas. 
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